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AN  IMPROVED  ALGORITHM  FOR  ADAPTIVE  PROCESSING 


INTRODUCTION 

A discrete  form  of  a least-mean-square  (LMS)  algorithm  based  on  the  method  of 
steepest  descent  was  given  by  Widrow  et  al.  [1]  as  a means  of  determining  the  weight 
vectors  for  minimizing  interference  entering  an  adaptive  array.  Their  algorithm  becomes 
unstable  for  fast  adaptation,  and  this  report  will  show  that  a modification  to  their  algo- 
rithm provides  unconditional  stability  and  better  performance  even  for  slow  adaptation. 


DISCUSSION 

The  steepest-descent  algorithm  was  given  in  Ref.  1 as 

W(j  + 1)  = W(j)  - 2ks  E(j)  XU),  (i; 

where  WU  + 1)  is  the  weight  vector  to  be  used  on  the  U + l)th  input  data  sample,  XU) 
is  the  jth  input  data  sample,  ks  is  a scalar  constant,  and  E(j)  is  the  error  signal  developed 
on  the  jth  data  sample  and  is  given  by 

EU)  = dU)  - WTU)  XU), 

in  which  dU)  is  the  jth  sample  of  the  desired  signal  and  WT  is  the  transpose  of  IV. 

In  general  XU)  and  WU)  are  multidimensional  vector  quantities.  A form  of  this  equa 
tion  is  given  in  Ref.  2 for  the  case  of  an  Applebaum-Howells  implementation  as 

WiU+V  = wi  O')  (l  - ■“)  + (~)  E(J)  V*  U),  (2) 

where  r is  the  filter  smoothing  constant,  G is  the  gain  term,  V,  O')  is  the  input  from  the 
ith  array  element,  with  V;  being  the  conjugate  of  V„  and 


m 


in  which  PU)  is  the  pilot  signal. 

To  simplify  the  analysis,  we  consider  the  special  case  of  a single  adaptive  loop  in  a 
sidelobe-canceler  configuration  [3]  as  shown  in  Fig.  1.  In  Fig.  1 the  main  input  is  ob- 
tained from  a radar  antenna  and  the  auxiliary  input  is  obtained  from  an  omnidirectional 
antenna  whose  gain  is  normally  greater  than  the  sidelobe  level  of  the  radar  antenna.  With- 
out loss  in  generality  the  pilot  signal  is  taken  as  the  main  input,  since  the  adaptation 
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= PU)  WfU)  v,  O'), 

i=i 


l 


criterion  (LMS)  is  unchanged.  The  single  sidelobe  canceler  corresponds  to  Fig.  8 in  Ref.  1, 
with  the  error  signal  defined  as 

m = vr  (t)  = vma)  - w(t)  vjt), 

where  Vr(t)  is  the  residue  signal,  Vm  (t)  is  the  radar-channel  signal,  which  is  taken  as  the 
desired  signal  response  in  Ref.  1,  W(f)  is  a weight  signal,  Va(t)  is  the  auxiliary -channel 
signal,  and  all  functions  correspond  to  complex  modulation  functions.  The  sidelo'oe- 
canceler  interpretation  is  also  discussed  in  Ref.  4.  From  (2)  the  adaptation  algorithm 
for  the  sidelobe  canceler  becomes 

W(j  + 1)  = KW(j)  + G(1  - K)  E(j)  V*  (j),  (3a) 

with 

m = vm  v)  - wv)  va  o),  (3b) 

where 

*=1-1=1-  27T f3dB, 

in  which  fa B is  the  integrating-filter  3-dB  bandwidth  normalized  to  the  sampling  fre- 
quency fs. 
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Frorn  (3a)  it  is  seen  that  the  next  weight  W(j  + 1)  is  derived  in  terms  of  the  present 
weight  and  present  value  of  E{j)  Va  (j).  The  weight  W(j  + 1)  is  then  used  with  the  next 
auxiliary  signal  input  to  determine  the  residue.  For  fast  loops,  W(j  + 1)  derived  from  the 
present  data  is  not  the  proper  weight  for  the  new  input  data.  The  effect  is  to  introduce 
a phase  shift,  not  present  in  actual  loops,  which  causes  loop  instability.  To  avoid  this 
instability  and  to  provide  better  cancellation  performance  and  more  realistic  loop  Simula- 
tion,  a preferred  algorithm  is 


W(j)  = KW(j  - 1)  + G(1  - K)  E(j)  V*  O'), 


(4a) 


with 


EU)  = 0)  - W(j)  Va(j).  (4b) 

In  this  algorithm  the  weight  applied  to  Va(j)  is  derived  in  terms  of  present  input  values 
In  effect  the  weight  is  taken  prior  to  the  delay  in  Fig.  7 of  Ref.  1 rather  than  after  it 
Ihus  the  weight  is  proper  for  the  current  data  input  rather  than  for  the  input  data  one 
sample  interval  earlier. 


STABILITY  CONSIDERATIONS 


The  steepest-descent  algorithm  given  by  (3)  is 


W(j  + 1)  = KWU)  + G(  1 - K)  [ Vm(j)  - W(j)  Va(j)]  V*  0).  (5) 


For  a step  input  with  Va(j)  equal  to  a constant  and  also  equal  to  V (j) 
are  perfectly  correlated,  (5)  may  be  written  as 


so  that  the  signals 


W(j  + l)  = W(j)  (K  - A)  + A, 

where 


(6) 


A = G(l-K)  IVaQ)l2. 

Letting  W(l)  equal  0,  it  is  found  from  several  iterations  of  (6)  that  the  general  term  is 


where 


W(N)  = — 


(1  -x^-l) 
1 - x 


x = K - G(l  - K)  \Val2. 
For  stability  it  is  required  that  |x|  < 1 or 

|G(1  - K ) \Va\2-K\  < 1. 


(7) 


(8) 
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Substituting  the  value 

K = 1 = 1 - 2nfadB 

in  (8)  leads  to 

(1  + G)  |Vfl|2  ^ < ! (9) 

Also,  the  weight  will  not  ring  in  amplitude  for  A less  than  unity. 

A stability  condition  derived  for  the  sidelobe  canceler  version  of  (1)  is  found  to  be 

II  + 2ks\Va\2\  < 1, 

which  agrees  with  the  stability  condition  given  by  equation  (27)  in  Ref.  1,  with  \Va\2  in 
our  case  being  equal  to  the  unique  eigenvalue. 

Computer  simulations  were  run  to  demonstrate  the  instability  associated  with  use  of 
(3)  and  are  shown  in  Figs.  2a  and  2b.  In  these  simulations  G equals  100  and  \Va\2  equals 
2.  From  (9)  the  stability  condition  for  the  specified  values  of  G and  |VQ|2  is 

fzdB  < 0.00158.  (10) 
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Fig.  2a  — Response  of  the  steepest-descent  algorithm 
when  f3dB  = 0.00155 
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Fig.  2b  — Response  of  the  steepest-descent  algo- 
rithm when  f^g  = 0.00162 


Figure  2a  shows  a dampled  oscillation  occurring  for  f3dB  equal  to  0.00155,  and  Fig.  2b 
shows  instability  occurring  for  f3dB  equal  to  0.00162,  with  the  weight  phase  alternating 
between  0 and  180  degrees  and  the  weight  magnitude  growing  unbounded. 

For  the  improved  algorithm  the  general  weight  term  of  (4)  for  a step  input  of  con- 
stant value  and  Vm  equal  to  VQ  may  be  shown  to  be 


W(N)  = 


C (1  -PN) 
1 - D ’ 


(11) 


where 


C = 


K 
1 + A 


and 


D = 


1 + A' 


Since  D is  less  than  unity,  W(N)  is  unconditionally  stable.  In  Fig.  3 the  response  to  a 
step  input  is  plotted  using  the  improved  algorithm  for  the  same  value  of  f3dB  (0.00162) 
which  caused  unstable  operation  of  the  steepest-descent  algorithm  (Fig.  2b).  There  is 
no  overshoot  or  ringing  in  Fig.  3,  since  the  response  is  unconditionally  stable. 
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Fig.  3 — Response  of  the  improved  algorithm 
when  fMB  = 0.00162 


SIMULATION  OF  RANDOM  INPUTS 

Computer  simulations  were  run  using  independent  samples  of  a Gaussian  random  pro- 
cess having  a mean  of  0 and  a variance  equal  to  2.  Successive  samples  were  correlated  by 
taking  a sliding-window  average  of  two  samples  and  renormalizing  so  that  the  resultant 
power  remained  equal  to  2.  The  same  samples  were  then  applied  to  the  main  and  auxiliary 
channels  of  the  sidelobe  canceler.  The  steepest-descent  algorithm  and  the  improved  algo- 
rithm were  compared  for  an  input  step  of  random  values  which  were  the  same  for  each 
simulation.  In  these  simulations  a constant  target  signal  was  introduced  in  the  radar  chan- 
nel at  sample  number  250  at  a clutter-to-signal  level  of  20  dB. 

The  steepest-descent  and  improved  algorithms  are  shown  in  Figs.  4a  and  4b  for  fag 
equal  to  0.00025,  which  corresponds  to  an  effective  loop  bandwidth  (BE)  to  jammer  band- 
width ( Bj ) ratio  of  0.1.  BE  is  defined  as 

Be  = (l  + G\vJ)fzdB. 


Comparison  of  Figs.  4a  and  4b  shows  that  the  steepest-descent  algorithm  gives  more  points 
of  lower  cancellation  (under  the  40-dB  line  for  example)  than  the  improved  algorithm  gives 
This  is  attributed  to  the  ringing  in  the  steepest-descent  algorithm  which  is  present  even  for 
the  slower  loop  adaptation.  Ringing  will  occur,  as  previously  mentioned,  when  A of  (7) 
is  greater  than  1.  Thus  use  of  the  relation 

A = G(1  -K)\VaU)  I2  < 1 

and  of  the  loop  parameters  G = 100  and  fag  = 0.00025  leads  to  the  requirement  for 
ringing  that 


|Vo0)  I > 2.52. 
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Fig.  4a  — Response  of  the  steepest-descent  algo- 
rithm when  f3dB  = 0.00025 


Fig.  4b  — Response  of  the  improved  algorithm 
when  f3dB  = 0.00025 


Since  Va(J)  is  a Gaussian  random  variable  with  a mean  of  0 and  a variance  equal  to 
2,  I Va(j)\  is  Rayleigh  and  the  probability  of  |Va0')l  being  greater  than  2.52  is 

PR(Wa{j)\  > 2.52)  = <r(2-522)/4  = o.20. 

Hencp  tnere  is  a 20%  probability  of  causing  ringing  in  this  slow-loop  simulation.  The  result 
of  this  ringing  is  to  cause  degraded  cancellation  of  jamming  signals  which  is  due  strictly  to 
the  algorithm. 
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In  Figs.  5a  and  5b  the  steepest-descent  and  improved  algorithm  results  are  shown  for 
fzdB  = 0.00124,  or  correspondingly  Be/Bj  = 0.5,  and  poor  performance  is  seen  to  result 
for  the  steepest-descent  algorithm  whereas  good  performance  is  obtained  with  the  improved 
algorithm.  For  the  case  of  fzdB  = 0.0025,  or  Be/Bj  = 1,  the  steepest-descent  algorithm 
gives  unstable  loop  performance  and  (Fig.  6)  the  improved  algorithm  gives  stable  perfor- 
mance. 


Fig.  5a  — Response  of  the  steepest-descent  algo- 
rithm when  fMB  = 0.00124 


Fig.  5b  — Response  of  the  improved  algorithm 
when  fMB  = 0.00124 
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Ki|{.  6 - K«'%|M>nsr  of  the  improved  algorithm 
when  • 0.002!) 


SUMMARY 


A comparison  of  algorithms  was  shown  for  a single  loop  in  a sidelobe-canceler  applica- 
as  an  illustration.  The  concept  (generalizes  to  any  adaptive  processing  which  minimizes 
nean-square  error.  The  generalization  of  I II  for  M multiple  loops  is  given  for  the  ith 
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1V1 

m = vmu)  - ^ wHu)  vnu). 


where  the  weights  are  derived  as  just  explained. 


In  conclusion  it  has  been  shown  that  the  improved  algorithm  is  unconditionally  stable 
and  provides  better  performance  than  the  LMS  algorithm  based  on  the  method  of  steepest 
descent.  The  steepest-descent  algorithm  was  shown  to  cause  a degradation  in  cancellation 
performance  due  to  its  tendency  to  ring  when  driven  by  random  noise  even  for  loop  para- 
meters which  are  slow  on  the  average.  Also,  the  improved  algorithm  provides  a more 
accurate  means  of  simulating  actual  adaptive-loop  performance. 
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